Papers with Unsupervised contrastive sentence embedding models
Smoothed Contrastive Learning for Unsupervised Sentence Embedding (2022.coling-1)
Copied to clipboard
| Challenge: | Unsupervised contrastive sentence embedding models use InfoNCE loss function . increasing batch size leads to performance degradation when it exceeds threshold . |
| Approach: | They propose a simple smoothing strategy upon the InfoNCE loss function to reduce the number of false-negative pairs in a batch without increasing the batch size. |
| Outcome: | The proposed smoothing strategy improves unsupervised SimCSE on semantic similarity tasks. |